Cross-Modal Scene Networks
نویسندگان
چکیده
منابع مشابه
Cross-Modal Scene Networks
People can recognize scenes across many different modalities beyond natural images. In this paper, we investigate how to learn cross-modal scene representations that transfer across modalities. To study this problem, we introduce a new cross-modal scene dataset. While convolutional neural networks can categorize scenes well, they also learn an intermediate representation not aligned across moda...
متن کاملCross-Modal Scene Perception
We report the effect of cross modal performance on the recognition of familiar objects arranged in a scene. In two separate experiments, participants had to learn the position of objects in a scene either by viewing the objects (visual learning) or by feeling the objects (haptic learning). After learning, the experimenter swapped two of seven object positions and the participant's recognition m...
متن کاملMulti-Modal Scene Interpretation
The visionary goal of developing an easy to use service robot implies several key tasks such as speech understanding, object recognition and scene understanding. Besides the more sensor-oriented capabilities such systems need extensive meta knowledge, e.g., about mental representations of spatial relations to match the view between man and machine. Only if all parts fit together an unrestricted...
متن کاملCo-inference for Multi-modal Scene Analysis
We address the problem of understanding scenes from multiple sources of sensor data (e.g., a camera and a laser scanner) in the case where there is no one-to-one correspondence across modalities (e.g., pixels and 3-D points). This is an important scenario that frequently arises in practice not only when two different types of sensors are used, but also when the sensors are not co-located and ha...
متن کاملMulti-Modal Scene Understanding for Robotic Grasping
Current robotics research is largely driven by the vision of creating an intelligent being that can perform dangerous, difficult or unpopular tasks. These can for example be exploring the surface of planet mars or the bottom of the ocean, maintaining a furnace or assembling a car. They can also be more mundane such as cleaning an apartment or fetching groceries. This vision has been pursued sin...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Pattern Analysis and Machine Intelligence
سال: 2018
ISSN: 0162-8828,2160-9292,1939-3539
DOI: 10.1109/tpami.2017.2753232